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APPROXIMATIONS  IN  MULTI-SERVER  POISSON  QUEUES 


Shirley  A.  Nozaki  and  Sheldon  M.  Ross 


0.  INTRODUCTION  AND  SUMMARY 


In  this  paper  we  consider  an  M/G/k  queueing  system  - that  is  a system  in 
which  customers  arrive  in  accordance  with  a Poisson  process  having  rate  X , 
and  are  serviced  by  one  of  k servers,  each  of  whom  has  service  distribution 
G . Upon  arrival  a customer  will  either  enter  service  if  at  least  one  server 
is  free  or  else  join  the  queue  if  all  servers  are  busy.  Our  results  will  be 
independent  of  the  order  of  service  of  those  waiting  in  queue  as  long  as  it  is 
supposed  that  a server  will  never  remain  idle  if  customers  are  waiting.  To 
facilitate  the  analysis,  however,  we  will  suppose  a service  discipline  of 
"first  come  first  to  enter  service." 


Our  major  objective  is  to  obtain  an  approximation  for  the  average  time 
spent  waiting  in  queue  by  a customer  - call  it  . This  is  done  by  means  of 

an  approximation  assumption  presented  in  Section  2,  which  is  shown  to  be 
asymptotically  valid  both  in  heavy  and  in  light  traffic.  In  Section  3 the 
approximation  assumption  is  used  to  derive  an  approximation  for  . Numerical 

comparison  with  tables  given  by  Hillier-Lo  in  the  special  case  of  Erlang  service 
times  indicate  that  the  approximation,  which  depends  on  the  service  distribution 
only  through  its  first  two  moments,  works  remarkably  well.  In  addition,  as  a 
by-product  of  our  analysis,  we  also  obtain  approximations  for  the  distribution 
of  the  number  of  busy  servers  and  the  mean  length  and  number  of  customers  in  a 
busy  period.  These  latter  approximations  depend  on  the  service  distribution 
only  through  its  mean. 

In  Section  4 we  show  that  the  approximation  assumption  is  valid  and  leads 
to  the  exact  result  in  the  case  of  a limited  capacity  system  where  no  queue  is 


allowed  to  form. 


I 


1.  BASIC  DEFINITIONS  AND  FUNDAMENTAL  EQUATION 
We  shall  need  the  following  notation: 

P^:  the  steady  state  probability  that  there  are  1 people  in  the 

system 

S:  a service  time  random  variable,  i.e.,  P{S  < x}  » G(x) 

Wq:  the  average  amount  of  time  that  a customer  spends  waiting  in  queue 
(does  not  include  service  time) 

Lq:  the  (time)  average  number  of  customers  waiting  in  queue 
V:  the  (time)  average  amount  of  work  in  the  system,  where  the  work 

in  the  system  at  any  time  is  defined  to  be  the  total  (of  all  servers) 
amount  of  service  time  necessary  to  empty  the  system  of  all  those 
presently  either  being  served  or  waiting  in  queue. 

We  will  make  use  of  the  following  idea  (previously  exploited  in  such 
papers  as  [1],  [2]  and  [5])  that  if  a (possibly  fictitional)  cost  structure  is 
imposed,  so  that  customers  are  forced  to  pay  money  (according  to  some  rule) 
to  the  system,  then  the  following  identity  holds  - namely 

(time)  average  rate  at  which  the  system  earns  money 
(1)  * average  arrival  rate  of  customers  * average  amount 

of  money  paid  by  a customer. 

A heuristic  proof  of  the  above  is  that  both  sides  of  (1)  times  T is 
approximately  equal  to  the  total  amount  of  money  paid  to  the  system  by  time 
T , and  the  result  follows  by  dividing  by  T and  then  letting  T -*•  « . ^ 


A rigorous  proof  along  these  lines  can  easily  be  established  in  the  models 
we  coneider  since  all  have  regeneration  points.  More  general  conditions 
under  which  it  is  true  are  presented  in  [1]. 


iASiMBfanaa] 
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By  choosing  appropriate  cost  rules  many  useful  formulas  can  be  obtained 
as  special  cases  of  (1).  For  instance  by  supposing  that  each  customer  pays 
$1  per  unit  time  while  in  service,  Equation  (1)  yields  that 


average  number  in  service  ■ AE[S] 


Similarly  by  supposing  that  each  customer  pays  $1  per  unit  time  while  waiting 
in  queue,  we  obtain  from  (1)  that 


LQ  " >WQ 


Also,  if  we  suppose  that  each  customer  in  the  system  pays  $x  per  unit  time 
whenever  its  remaining  service  times  is  x , then  (1)  yields  that 


V = AE  SWq  + J (S  - x)dx 
0 


(eK) 


+ E(S  )/2 


AE[S]Wq  + AE[S*]/2 


where  is  a random  variable  representing  the  (limiting)  amount  of  time 

that  the  n-th  customer  spends  waiting  in  queue. 

Equation  (4)  will  be  of  particular  use  to  us. 

Another  important  fact  which  we  shall  use  is  that,  since  our  arrival 
stream  of  customers  is  a Poisson  process,  the  probability  structure  of  what 
an  arrival  observes  is  identical  to  the  steady  state  probability  structure  of 
the  system.^  Thus,  for  instance  AE[S]  will  equal  the  average  number  of 
busy  servers  that  an  arrival  observes;  V , will  equal  the  average  amount  of 


Intuitively  this  is  so  since  for  a Poisson  arrival  process  (a)  the  distribution 
of  the  times  at  which  arrivals  occur  is  uniform,  and  (b)  given  that  an  arrival 
occurs  at  time  t , the  conditional  distribution  for  the  remaining  arrivals  is 
the  same  distribution  as  for  the  original  Poisson  process. 


work  in  Che  system  as  seen  by  an  arrival;  and  , Che  probability  that  an 
arrival  finds  1 people  presently  in  the  system. 

As  a result  of  the  above  we  may  write  Equation  (1)  as 

Average  rate  at  which  system  earns  money 
(5)  ■ \ y P.  x average  amount  paid  by  a customer  finding 

s.  1 

*■  i people  already  in  the  system  when  he  arrives. 


6 


m 


2.  THE  APPROXIMATION  ASSUMPTION 


Let  G denote  the  equilibrium  distribution  of  G . That  is, 


Gfi(x) 


(1  - G(; 

eTs] 


also  let 


<$(x,y) 


1 if  x *•  y 


0 if  x + y 


We  shall  make  the  following  approximation  assumption. 


Approximation  Assumption: 


Given  that  a customer  arrives  to  find  i busy  servers,  i > 0 , then 


at  the  time  that  he  enters  service,  the  remaining  service  times  of  the  other 


i - 6(i,k)  customers  being  served  has  a joint  distribution  that  is  approximately 


that  of  independent  random  variables  each  having  distribution  Ge  . 


Heuristic  Remarks  Concerning  the  A. A.: 


1.  First  we  note  that  the  A. A.  is  asymptotically  true  either  in  heavy 


traffic  (that  is,  as  A E [ S ] -*■  k)  or  in  light  traffic  (that  is,  as 


XE[S]  0).  This  is  so  in  heavy  traffic  since  the  great  majority 


of  arrivals  will  encounter  a large  queue  and  as  a result  the  k 


departure  processes  (one  for  each  server)  they  observe  will  be 


approximately  independent  delayed  renewal  processes.  Hence,  consider- 


ing those  customers  served  by  server  i , it  follows  that  when  they 


enter  service  they  would  have  been  observing  k - 1 independent 


delayed  renewal  processes  for  a large  time,  and  the  A. A.  follows 


since  the  limiting  distribution  of  excess  in  a renewal  process  is 


just  G 


I-  Wifffkl 
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In  extremely  light  traffic  the  great  majority  of  arrivals  will 
find  either  0 or  1 busy  servers.  Now  since  Poisson  arrivals  see  the 
system  as  it  is  (averaged  over  all  time)  it  follows  that  arrivals 
finding  1 server  busy  would  encounter  the  same  additional  service 
time  (for  the  busy  server)  as  would  random  (and  uniform)  time  sampling 
of  the  excess  of  a renewal  process.  Hence,  the  A. A.  follows  in  light 
traffic  from  the  renewal  process  (excess)  result. 

2.  In  fact  the  same  reasoning  given  above  for  light  traffic  shows  that 

if  we  isolate  attention  upon  a particular  server,  then  whenever 

customers  arrive  to  find  this  server  busy,  the  remaining  service 

time  will  have  distribution  G . Now  it  should  be  noted  that  this 

e 

is  not  the  same  as  saying  (as  the  A. A.  does)  that  the  remaining 

service  time  of  this  server  will  have  distribution  G at  the  moment 

e 

when  a customer  is  about  to  enter  service  (as  opposed  to  when  he 
arrives) . However  we  might  hope  that  it  should  be  close. 

3.  Additional  heuristics  for  the  A. A.  follows  from  the  fact  that  it  is 
known  to  be  (exactly)  true  when  no  queue  is  allowed  (see  Section  4). 


■IPIPPPPWPIPI 

' •mr  VJ4**^'** 


3.  THE  APPROXIMATION 

For  any  arbitrary  arrival  we  have  the  following  identity: 

work  in  the  system  at  the  time  of  his  arrival 
■ k x time  he  spends  waiting  in  queue  + R 


where 


R = sum  of  the  remaining  service  times  of  all  those  being 
served  at  the  time  when  the  arrival  enters  service. 

Taking  expectations  yields,  since  a Poisson  arrival  sees  the  system  as 
it  is  in  steady  state,  that 


V - kWQ  + E[R]  . 


To  obtain  E [ R ] we  condition  on  B , the  number  of  servers  that  are  busy  when 
the  customer  arrives. 


E(R]  *=  E [ E ( R/ B * ] 


E [ B - 6 (B,k) ] 


E[S2] 


2E[S] 

00 

where  the  last  equation  follows  from  the  A. A.,  and  the  fact  that  ^ xdGg(x) 


E[S  ]/2E[S]  . Since  E[B]  * A E [ S ] from  Equation  (2),  we  obtain  that 


E[R]  * A 


E[S2] 


nn  p{  B 

2 E [ S ] 


k} 


Eisii 


Hill  p 

2EfS]  k 


where 


k-1 

1 * l Pi 


i-0 
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Hence, 


v : kU  + x Mill . iisii  f 

V *WQ  + A 2 2E[S]  *k 


However,  from  Equation  (4)  we  know  that 


V - X E [ S ] WQ  + \ 


implying  that 


E[S2]Pk 

(6)  WQ  “ 2 E [ S ] (k  - AE[S] ) ' 

Thus  we  need  . To  obtain  the  probability  distribution  of  the  number  of  busy 
servers  we  impose  the  following  fictitional  cost  structure  - namely  that  the  i 
oldest  customers  in  the  system  pay  $1  per  unit  time,  i » 1,2,  ...,  k , where 
the  age  of  a customer  is  measured  from  the  moment  it  enters  the  system.  Hence, 
letting  S^,S®,  ....  S®  denote  k - 1 independent  random  variables  each 
having  distribution  Gg  we  obtain  from  Equation  (5)  that 


(7) 


Pj  + 2P2  + •••  + (i  - DPi_1  + i(l  ~ PQ 


Pi-1> 


» X(PQ  + •••  + Pi_1)E[S]  + APjEps  - min(s®,S® S*))  j 

- 2nd  smallest  of  |s®,  ...»  S®+jjj  J 


+ APi+lE 


+ APk-2E 


+ X (1  - P 


[(s  - (k  - 1 - i)th  smallest  of  |s®,  S®  2)j  j 

)e£|s  - (k  - i)th  smallest  of  ^S®,  ...,  S®_jjj 


- P 


k-2' 


i * 1 , . . . , k - 1 


Px  + 2P2  + •••  + (k  - l)Pk_1  + kd  - PQ  - - Pk-1)  - *E[S] 


. 


i^n 


that  i < k . Now  as  only  the  i oldest  pay  It  follows  that  when  j customers 
are  present  the  system  earns  at  a rate  j when  j < i and  at  a rate  1 when 
j > i . Hence  the  left  side  of  Equation  (7)  represents  the  average  rate  at 


which  the  system  earns.  On  the  other  hand  an  arrival  finding  fewer  than  i 
customers  already  in  the  system  will  Immediately  go  into  service  and  will  pay 
a total  amount  equal  to  his  service  time;  while  an  arrival  finding  j present, 
k - 1 > J > i will  also  go  immediately  into  service  but  will  only  begin  paying 

when  j - i + 1 of  the  j others  in  service  leave.  Thus  in  this  latter  case, 

under  the  A. A.,  the  arrival  would  expect  to  pay  a total  of  E^|s  - (J  + 1 - i)th 

smallest  of  (SI’S2 S'))+]  • Finally  if  the  arrival  found  more  than  k - 2 

busy  servers  then  he  will  begin  paying  after  k - i of  those  customers  in  service 
when  he  enters  service  leave  the  system.  This  explains  the  first  k - 1 of  the 
set  of  Equation  (7).  The  last  equation  (when  i ■ k)  easily  follows  since  in 
this  case  each  customer  will  pay  a total  equal  to  his  time  in  service. 

To  simplify  the  set  of  Equation  (7)  we  will  need  the  following  lemma. 

Lemma  1 : 

g 6 

If  S,Sj,  ...»  Sr  are  independent  random  variables  such  that  S has 

distribution  G and  the  others  G , then 

e 

E Jj^S  - jth  smallest  of  ...,  j = V * ^ ^ E[S]  . 

Proof : 

Using  the  identity 

(x  - y)+  * x - min(x,y) 
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we  have  chat 


e[(s  - 


E[S]  - 


e e\+l 

jth  smallest  of  S^,  . ...  S^.  M 

E jrain , jth  smallest  of  S®,  ....  S®jj 


Now, 


E^min^S,  jth  smallest  of  S®,  ....  S®jj 
00 

f P{S  > a}pjjth  smallest  of  |s®,  ...,  S > ajda 


fil-  G (a) ) Y (J)  (Ge(a))1(l 


Ge(a))r_ida 


J;1 

= E[S] 

l 

i-0 

j-1 

“ E[S] 

l 

i-0 

= E[S] 

r + 

(■ 


by  the  substitution 


y - Ge(a) 


* ■ <4r§P d‘) 


which  proves  the  lemma.® 

Hence,  using  Lemma  1,  the  Equation  (7)  become 


P + 2 P 2 + + (i  - DP^i  + i(l  - p0  ~ " Pi-l) 


- X(PQ  + •••  + P^^EtS]  + XPt  YTj  E[S]  + •••  + APr_2 


E[S] 


(8) 


+ A(1  - P 


0 


- \-2>  k E1S1  ' 


i m 1 , . . . , k - 1 


P,  + 2P„  + •••  + (k  - l)Pk-1  + k ( 1 - P( 


1 "2 
A E [ S ] . 


- pk-i> 


U*.  ^ w 
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Now,  as  the  above  equations  for  the  , i ■ 0,1,  . k - 1 , depend 
only  on  G through  E[S]  and  as  the  equations  are  exactly  true  when  G la 
exponential  (since  the  A. A.  is  exact  when  G is  exponential)  it  follows  (since 
it  can  be  shown  that  the  set  of  equations  has  at  most  one  solution)  that  the 
solution  of  (8)  is  identical  to  the  well  known  solution  in  the  case  M/M/k. 

That  is, 


fk-i 

vk 

Ln*0 


(AE[ S] )/n!  + 


(*E(SI) 

(k  - 1)! (k  - AE[ S] ) 


r 


and 


; (ms])1 

i i!  o * 


i = l,  . . . , k - 1 . 


Hence , 


Pk  = 


(k  - 1) ! (k  - A E[S ] ) 


( A E t S ] ) 

y (ae[ s ) )n 

n "! 
n=0 


( A E [ S 3 ) 


(k  - 1) ! (k  - A E [ S ] ) 


and  our  approximation  for 


is  thus  given  by 


(9)  WQ  = 


AkE[S2](E[S])k~1 


2 (k  - 1)! (k  - AE[S])‘ 


ky  (AE[S])n 

Ln  n! 
n-0 


(AE[S3 ) 

(k  - 1) ! (k  - AE[S] ) 


In  the  special  case  of  two  servers,  k = 2 , we  have  that 


p ; Pels])2 
2 2 + A E [ S ] 


when  k = 2 


and  (9)  reduces  to 
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W 


X2E[S2]E[S] 


Q 2(2  - XE[S] ) (2  + XE[S] ) 


when  k * 2 . 


Numerical  tables  for  Lq  have  been  published  by  Hillier  and  Lo  In  the 
special  case  M/Er/k,  where  Ef  represents  an  Erlang  distribution  with  r 
phases.  That  is,  a service  time  has  the  same  distribution  as  the  sum  of  r 
independent  and  identically  distributed  exponential  random  variables.  The 
following  tables  compares  our  approximate  formula  for  (namely  XW^) 

with  the  Hillier-Lo  tables. 

It  is  also  interesting  to  see  how  our  approximation  for  the  probability 
that  all  servers  are  busy  (call  it  P{all  busy})  compares  with  the  actual 
values  in  the  special  case  M/Er/k.  Again  referring  to  the  Hillier-Lo  tables 
we  have  Table  3. 


Remarks : 

1.  It  is  interesting  to  note  that  in  all  cases  the  approximation  for 
is  slightly  less  than  the  exact  value  in  the  case  of  Erlang  service 
times.  While  the  reason  for  this  is  by  no  means  apparent  and  further 
study  is  clearly  indicated  the  authors  feel  that  it  may  be  relevant 
that  the  Erlang  is  an  increasing  failure  rate  distribution. 

2.  The  approximation  for  also  leads  to  approximations  for  E[B] 

aid  E[C]  , the  expectations  of  the  length  of  and  the  number  of 
customers  served  in  a busy  period.  This  follows  since  from  the  theory 
of  alternating  renewal  processes  we  have  that 

P y± 

0 in  + E[B] 


or 


E[B] 


••  — ■ 
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Also,  letting  Xi  denote  the  time  between  the  i-th  and  (1  + l)st 
arrival  then 


However,  by  Wald's  equation 


TABLE  1 


bottom  number  in  box  = exact  value  as  given  by  Hillier- 
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top  number  In  box  • approximation  for  Lg 
bottom  number  In  box  - exact  value  aa  given  by  Hlllier- 


In  this  section  we  suppose  that  arriving  customers  that  find  all  servers 
busy  are  lost  to  the  system.  In  this  case  it  is  known  (see  [6])  that  the  A. A. 
is  exact.  The  limiting  probabilities  can  be  obtained  by  again  supposing 
that  the  i oldest  customers  pay  $1  per  unit  time  while  in  the  system. 

From  the  fundamental  Equation  (5)  and  Lemma  1 we  obtain  the  equation 

?1  + 2p2  + •••  + a - i)pw  + id  - pQ  - •••  - p1-x) 

j 

■ ‘<p0 + •••  - pi-l)Elsl  + >P1  rrr EIS1  + ••• + ‘Pk*2  rh: E[sl  + XP1-1  i E[s)  • 

i ■ 1 k - 1 

» 

1 

j ?1  + 2P2  + •••  + kPk  - A (1  - Pk)E[S]  . 

i 

The  above  equations,  along  with  the  equation, 


i 


R> 


- J i ! 

%\l  •, 


h;'  sj 

i-  < * 


F 


■!  I 


i; 


I 
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5.  FUTURE  RESEARCH 


In  future  work  the  authors  are  planning  to  employ  the  approach  of  the 


present  paper  to  obtain  an  approximation  for  In  such  extensions  as 


(1) 


finite  capacity  models 
(11)  batch  arrival  models 

(ill)  models  in  which  each  server  has  a different  service 
distribution. 


It  is  felt  that  such  models  have  great  applicability  in  the  real  world. 
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